Non-Markovian Stochastic Resonance 
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The phenomenological linear response theory of non-Markovian Stochastic Resonance (SR) is 
put forward for stationary two-state renewal processes. In terms of a derivation of a non-Markov 
regression theorem we evaluate the characteristic SR-quantifiers; i.e. the spectral power amplifica- 
tion (SPA) and the signal-to- noise ratio (SNR), respectively. In clear contrast to Markovian SR, 
a characteristic benchmark of genuine non-Markovian SR is its distinctive dependence of the SPA 
and SNR on small (adiabatic) driving frequencies; particularly, the adiabatic SNR becomes strongly 
suppressed over its Markovian counterpart. This non-Markovian SR theory is elucidated for a fractal 
gating dynamics of a potassium ion channel possessing an infinite variance of closed sojourn times. 

PACS numbers: 05.40.-a, 82.20.Uv, 87.16.Uv 



The concept of Stochastic Resonance (SR), originally 
put forward for the description of the periodicity of the 
earth's glacial recurrences 0, has acquired an immense 
popularity in the context of weak signal transduction in 
stochastic nonlinear systems . The phenomenon of SR 
is seemingly rather paradoxical: an optimal dose of either 
external or internal noise can considerably boost signal 
transduction. The archetypical situation of SR involves 
a periodically rocked, continuous state bistable dynamics 
driven by thermal, white noise Q- The essential features 
of the perturbed bistable dynamics can be captured by a 
two-state stochastic process x{t) that switches forth and 
back between two metastable states xi and X2 at random 
time points {ii}. This two-state random process can be 
directly extracted from filtered experimental data and 
subsequently statistically analyzed. 

If the sojourn time intervals — ti^i — ti are in- 
dependently distributed (an assumption being invoked 
throughout the following), the resulting two-state re- 
newal process is specified by two residence time distribu- 
tions (RTDs) ?/'i,2(r) 0. Commonly, one follows the rea- 
soning of McNamara and Wiesenfeld Q; i.e. one approx- 
imates the reduced dynamics by a two-state Markovian 
process with the corresponding RTDs being strictly ex- 
ponential, 4'i,2(t) = J^i,2 exp(— z^i.2t). Here, vi_2 are the 
transition rates which are given by the inverse mean resi- 
dence times (ri,2) := /g r^i,2(T)(ir; i.e. z/1,2 = (n,2)^"^- 
The input signal f{t) yields time-dependent transition 
rates 1^1,2 i^i,2{t). The probabilities pi,2(i) of the states 
xi,2 obey the Markovian master equation i.e. 
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with the time-dependent rates. Applying a weak periodic 
signal of the form f{t) = /ocos(r2t) yields for the asymp- 
totic linear response {Sx{t)) = fo\x{^)\ cos{flt — ip{^)). 
Here, x(r2) is the linear response function in the fre- 
quency domain and (p{fl) denotes the phase shift. For 
adiabatic, Arrhenius-like transition rates 1^1,2 (i) that de- 
pend on temperature T and driving signal f(t), the linear 
response function x(^) is known explicitly The SPA 
HjSIj ''7 = lx(^)l^j then displays the phenomenon of SR; 
i.e. the quantity rj depicts a bell-shaped behavior on the 
thermal noise strength T This appealing two-state 



Markovian SR-theory due to McNamara and Wiesenfeld 
01 enjoys great popularity and wide spread application 
in SR-research Moreover, this seminal Markovian 
scheme has recently been generalized in order to unify 
the various situations of SR - such as periodic or ape- 
riodic SR 7] and non-stationary SR ~ within a unified 
framework based on information theory Q . 

One may encounter, however, an ample number of 
other physical situations where the observed stochastic 
two-state dynamics x{t) exhibits strong temporal long 
range correlations that are manifestly non-Markovian in 
nature with profo undly non- exponential, experimentally 
observed RTDs 9, 10, 11, 12]. In principle, any deviation 
of RTDs from a strictly exponential behavior constitutes 
a deviation from a Markovian two-state behavior |^, al- 
though in practice it can be rather small. A clear-cut, 
genuine non-Markovian situation emerges when, e.g., one 
of RTDs possesses a very large, possibly infinite variance 
var(ri,2) = /q (r — (ri,2))^V'i,2(T)dr — > 00. As a spe- 
cific example, this situation occurs for the stochastic dy- 
namics of the conductance fluctuations in biological ion 
channels for which the RTDs generally assume a non- 
exponential behavior. The corresponding RTD ^(t) can 
either be described by a stretched exponential |lOj, or 
possibly also by a power law ^{t) oc l/{b -\- t)^ , P > 
UJ. The case with a power law is particularly inter- 
esting: In Ref. [Tl'l one finds that the closed time RTD 
for a large conductance (BK) potassium channel assumes 
a power law with an exponent (3 w 2.24 implying that 
var(rc/ose(i) = go. As a consequence, the conductance 
fluctuations are expected to exhibit a characteristic 1//" 
noise power spectrum S{f) 0. Indeed, this result has 
been confirmed for the BK ion channel [Tjl , as well as for 
other types of ion channels |Q| . 

What are the characteristic signatures of non- 
Markovian SR in these and several other, manifestly 
non-Markovian phenomena? To address this challenge 
we herewith put forward the non-Markovian general- 
ization of the well-known McNamara- Wiesenfeld two- 
state Markov theory to the case with arbitrary, non- 
exponential (!) RTDs V'i,2(''') and corresponding sur- 
vival probabilities ^i,2{t) = ip 1,2 {T')dT' , respectively 
3J. There do exist a few prior studies of non-Markovian 
SR based on a contraction of a (Markovian) stochas- 
tic dynamics onto a non-Markovian process; see, e.g., 



2 



in 0, 0, 0, 01 . However, the case of genuine non- 
Markovian SR with an infinite variance of sojourn times 
has not been investigated previously. Moreover, in clear 
contrast to these prior studies 0, 0| we do not 
presume here any knowledge of the underlying micro- 
scopic or mesoscopic dynamics. In practice, such a meso- 
scopic dynamics is not accessible, or is simply not known. 
Instead, we pursue with this work a phenonienological 
scheme of non-Markovian SR which is solely based on the 
experimentally observed RTDs tpi 2{T) in the absence of 
an input signal. 

Propagator for two-state renewal processes. A first 
challenge presents the derivation of the propagator 
n(t|to) of the unperturbed persistent two-state renewal 
process x{t). The quantity Il{t\to) relates the probabil- 
ity vector p{t) = [pi{t),p2{t)]'^ at two different instants 
of time t and to, i.e., p{t) = Il{t\to)p{to) ■ One can explic- 
itly find n(t|to) by considering the various contributions 
of all possible stochastic paths that lead from p(to) to 
p{t). Let us split up these contributions as follows 



n(i|to)-^n(")(t|to), 
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where the index n denotes the number of corresponding 
switches that occurred during the stochastic evolution. 
The contribution with zero alternations is obviously given 
by 



n(o)(i|to) = 
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Stochastic paths with a single alternation contribute the 
weight 
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Note that for the persistent renewal process to be strictly 
stationary [T^ . the survival probability ^^i\{t) of the 
first residence time interval = ti — tg in Eq. |j2Jl and 
the corresponding RTD tpi^lir) = -d$J°^(r)/dr in Eq. 
© must be chosen differently from all subsequent ones. 
Stationarity requires that [MMIl^. 
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where $1,2 (t) = /°° "01,2(0'^^ ^■'"s the given survival prob- 
abilities. From ^ it follows that the mean residence 
time (ti_2} must assume finite values, (ti_2} oo. This 



imposes a salient restriction. Next, the paths with two 
switches contribute to Eq. ||2Jl as 
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where 
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and, likewise, for all higher n. Because Il{t\to) de- 
pends only on the time difference, r — t — to, the in- 
finite, multiple- integral series 0-® can be summed 
exactly by use of a Laplace-transform. If we denote 
the Laplace transform for a function A{t) by A{s) := 
/g exp{—st)A(T)dT we find 



n(s) = - 

s 



1 - 
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G(s) 
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where 



G{s) = ^ (11) 

r-i r-iL 

in agreement with the known result in Refs. 3, 9]. 

Non-Markov Regression Theorem. From H1U|I - H11() 
one finds the stationary probabilities as p®* = 

lims^o (^511(5)^(0)^ . These explicitly read pf*2 = 

('''i,2)/[('''i) + {t2)]- The generally non-exponential re- 
laxation of {x(t)) to the stationary mean value Xst = 
xipf -\- X2P'2 is described by the unique relaxation func- 
tion R{t), i.e. 

Pi,2(to + t)= pI% + [piAto] - Pi,2] Rir) (12) 
where R{t) obeys the Laplace-transform 



R{s) = i - ("^ + ^) 1g{s) . 

S \{ti) (t2)J s2 

Let us consider next the autocorrelation function 

{Sx{t + T)Sx{t)) 



k{T) = lim 



t^oo {Sx'^)st 



(13) 
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of stationary fluctuations, Sx{t) — x{t) — Xgt- With 



{Sx{t + T)Sx{t)) = {x{t + T)x{t)) - {x)lt as t 



and 



}mi^{x{t + T)x{t)) ^Y.J2 x,x,U,,{T)pf (15) 

i=l,2 j=l,2 

we find the same result as in Ref. i.e. 



1 \ 1 



S \{ti) {t2)J S^ 

Upon comparison of 113|) with Hl()|l the following regres- 
sion theorem holds for these non-Markovian two-state 
processes, namely 



i?(r) = fc(r) 



(17) 
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The regression theorem (|17|) . which relates the decay of 
the relaxation function R{t) to the decay of stationary 
fluctuations A:(t) , presents a first main result, yielding the 
cornerstone for the derivation of linear response theory 
for non-Markovian SR. 

Linear Response Theory. The common linear response 
approximation 

{6xit)) := {x{t)) - xst = r x(t - t')f{t')dt', (18) 

clearly holds independently of the underlying stochas- 
tic dynamics J^gJ. In H18|l . x(t) denotes the linear re- 
sponse function in the time domain. It can be found 
following an established procedure |23| : (i) apply a small 
static "force" /o, (ii) let the process x{t) relax to the 
constrained stationary equilibrium (x(/o)}, and (iii) sud- 
denly remove the "force" at t = t^. Then, in accord with 
(|TS|l the response function reads 



X{r) 



/o dr 



{Sx{to + T)), r>0. 



where {Sx{to + t)) = xipi{to + t) + X2P2{to + t) is 
determined by (|12|l with the initial ^1.2(^0) taken as 
PiMto) = (-ri,2(/o))/[(Ti(/o)) + (-r2(/o))]- Expanding 
Pi, 2(^0) to first order in /o we obtain 



{dx{to + t)) 



{Sx^)s 
Ax 



■[f32-f3i]R{T)fo + o{fo), (20) 



where Aa; — X2 ~ xi is the fluctuation amplitude and 



{6x^)st = (Ax)2 



(ti)(t-2) 
{{ri) + {r2)y 



(21) 



is the mean squared amplitude of the stationary fluctu- 
ations. Moreover, (3i^2 '■= rfln(Ti,2(/o)}/c(fo|/o=o in 
denotes the logarithmic derivative of mean residence time 
with respect to the input-signal strength. Upon combin- 
ing (|2()|l with the regression theorem (|17|l we obtain from 
()19|l the fluctuation theorem 



X{r) = -[P2 - f3i 



fl(T)^ 

' Aa; dr 



{Sx{t + T)5x{t)), 



(22) 



9{t) denotes the unit step function. The non-Markovian 
fluctuation theorem H22(l presents a second main result of 
this work; in particular, it does not assume thermal equi- 
librium 19]. If, in addition, the mean residence times 
commonly obey an Arrhenius-like dependence on tem- 
perature T and force /o; i.e. 



(ti,2(/o)) = Ai,2exp 



A[/i^2 T Aa:i,2/o 



(23) 



where A[/i^2 are the heights of activation barriers, Axi — 
zAx, Ax2 = (1 — z)/S.x with < 2; < 1, we recover for the 
fluctuation theorem in H22() the form which in particular 
holds true for a classical equilibrium dynamics [T^ I2(tI | ; 



X{r) 



d{T) d 

knT dr 



{Sx{T)SxiO)),t. 



(24) 



Spectral Power Amplification. In presence of an ap- 
plied periodic signal, see below (Q, the spectral power 
amphfication (SPA) 0, ry(f7) = |x(f^)P, where x('^) = 
J^oo x{t)^^'^*'dt, reads by use of the FT in (PHl upon com- 
bining iCH), (Unj, (EH, (123) as follows 



77(17, T) 



(Aa;/2)'' 



u\T) 



|G(if7)|^ 



{keTY cosh4[e(r)/(2fcBT)] 



(25) 



In (|25jl, v{T) = {ti)-^ + {T2y^ is the sum of effec- 
tive rates and e{T) = AU2 - AUi + TAS denotes 
the free-energy difference between the metastable states 
which includes the entropy difference AS" :— S2 — Si — 
kBln{A2/Ai). In the Markovian case we obtain G(s) = 
s/{s + v) and H25|) equals the known result, see in p|. 

Signal-to-Noise Ratio. The signal-to-noise ratio (SNR) 
within linear response theory is given by SNR(f2, T) := 
tt/q |x(f7)P/<S'Ar(ri), where Sn{u}) is the spectral power of 
stationary fluctuations 0. In the present case, Sn{uj) = 

(19) 2(fe^)stRe k{iu!) with {5x^)st from lEU and k{s) given 



in H16() . By use of (|25l) . we obtain 



SNR(r2,r) = 



^/2(Aa;/2) 



KT) 



e(T) 



2kBT) 



N{n), (26) 



where the term N{n) = \G{in)\'^ /Re[G{in)] denotes 
a frequency and temperature dependent non-Markovian 
correction. For arbitrary continuous V'i,2(t) and the 
high-frequency signals fl 3> {ti^2)~^, the function N{il) 
approaches unity. Then, Eq. (|26|l reduces to the known 
Markovian result i.e. the Markovian limit of SNR 
is assumed asymptotically in the high frequency limit. 
More interesting, however, is the result for small fre- 
quency driving. In the zero-frequency limit we ob- 
tain N{0) = 2/[var(Ti)/(Ti)2 + var(T2)/(r2)2]. With 
var(ri,2) = (r^a) - {^,2)^ = <x, N{0) = 0; i.e. 
SNR(0, T) = as well. Consequently, ultra-slow signals 
are difficult to detect within the SNR-mcasure. 

Application: fractal ion channel gating. Let us next il- 
lustrate our main findings for the case of a manifestly 
non-Markovian gating dynamics of ion channels that 
exhibit a fractal gating kinetics together with a 1//" 
noise spectrum of fluctuations 0, In this con- 

text, x{t) corresponds to the conductance fluctuations 
and the forcing f(t) is proportional to the time- varying 
transmembrane voltage. For a locust BK channel the 
measured unperturbed closed time statistics can be ap- 
proximated by a Pareto law; i.e. ^i{t) = (ti)^^(I + 
7-i)/[l -F7-V/(ri)]2+^ with 7 « 0.24 and (n) = 0.84 
ms. The open time RTD assumes an exponential form 
with {T2) — 0.79 ms For low w, the noise power 

reads SnIuj) oc 1/uj^~'^. Unfortunately, neither voltage, 
nor temperature dependence of mean residence times are 
experimentally available. Thus, we employ here the Ar- 
rhenius dependence in (|23|l . Namely, because the tem- 
perature dependence of the open-to-closed transitions is 
typically strong plj . we assume a rather high activa- 
tion barrier; i.e. AU2 = 100 kJ/mol (~ 40 kBTroom)- 
The closed-to-open transitions are assumed to be weakly 
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FIG. 1: (a) The spectral power amplification ri{Q), Eq. 1)25^ . 
(in arbitrary units) vs. temperature (in °C) for the BK ion 
channel gating scenario (see text) and (b) its comparison with 
a corresponding Markov modeling. 

temperature-dependent with AUi — 10 kJ/mol. Be- 
cause (ri) ^ {T2) at Troorm the difference between AUi 



and A/72 is compensated by an entropy difference AS* ~ 
—36 ks- The physical reasoning is that the closed time 
statistics exhibits a power law; i.e. the conformations 
in the closed state are largely degenerate. This in turn 
yields a larger entropy as compared to the open state. 

For these parameters, the spectral power amplification 
versus the temperature is depicted for various driving fre- 
quencies in Fig. la. Furthermore, Fig. lb corresponds to 
an overall Markovian modeling with an exponential ijji (t) 
possessing the same (ti ) . We observe a series of striking 
features in Fig. 1. (i) A distinct SR-maximum occurs in 
the physiological range of varying temperatures (caused 
by the entropy effects), (ii) Due to a profound intrin- 
sic asymmetry, the frequency dependence of the spectral 
amplification ri(fl, T) for the Markov modeling is very 
weak for small frequencies Vl <^ {ti,2)~^ In contrast, 
the non-Markovian SR exhibits a distinct low-frequency 
dependence (thereby frequency-resolving the three over- 
lapping lines in Fig. lb), (iii) The evaluation of the SNR 
yields - in clear contrast to the frequency-independent 
Markov modeling ~ a very strong non-Markovian SR fre- 
quency suppression of SNR towards smaller frequencies. 
The SNR-maximum for the top line in Fig. la is sup- 
pressed by two orders of magnitude as compared to the 
Markov case (not shown). As a consequence, for a strong 
non-Markovian situation it is preferable to use low-to- 
moderate frequency inputs in order to monitor SR. 

In conclusion, we have put forward the phenomenolog- 
ical two-state theory of non-Markovian stochastic reso- 
nance. This approach carries great potential for many 
applications in physical and biological systems exhibit- 
ing temporal long range correlations, such as they oc- 
cur in life sciences and geophysical phenomena (e.g. 
earthquakes), to name but a few. In clear contrast to 
Markovian-SR, a benchmark of genuine non-Markovian 
SR is its distinct strong frequency-dependence of cor- 
responding SR quantifiers within the adiabatic driving 
regime; cf. Fig. 1(a). 
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